Text copied to clipboard!
Title
Text copied to clipboard!Evaluator of Assessments
Description
Text copied to clipboard!
We are looking for a detail-oriented and analytical Evaluator of Assessments to join our team. This role is critical in ensuring the quality, fairness, and effectiveness of various assessment tools used across educational, corporate, and governmental settings. The Evaluator of Assessments will be responsible for reviewing, analyzing, and validating assessment instruments, ensuring they meet established standards and objectives. This position requires a strong understanding of psychometrics, data analysis, and educational or professional testing methodologies.
The ideal candidate will have experience in assessment design, evaluation, and validation, as well as a keen eye for detail and a commitment to continuous improvement. You will work closely with instructional designers, subject matter experts, and data analysts to ensure that assessments are aligned with learning outcomes or job competencies. Your insights will help shape the development of fair, reliable, and valid assessments that support learning, hiring, or certification goals.
Key tasks include conducting item analysis, reviewing test blueprints, analyzing test-taker performance data, and providing recommendations for improvement. You will also be expected to stay current with best practices in assessment and evaluation, including compliance with relevant standards such as the Standards for Educational and Psychological Testing.
This role is ideal for someone who is passionate about data-driven decision-making and has a strong background in education, psychology, or a related field. If you are looking to make a meaningful impact by improving the quality and effectiveness of assessments, we encourage you to apply.
Responsibilities
Text copied to clipboard!- Review and evaluate assessment tools for validity and reliability
- Conduct item analysis and statistical evaluation of test questions
- Collaborate with subject matter experts to align assessments with objectives
- Analyze test-taker performance data to identify trends and issues
- Develop reports and recommendations for assessment improvement
- Ensure assessments comply with industry standards and regulations
- Participate in the design and validation of new assessment instruments
- Maintain documentation of evaluation processes and outcomes
- Provide training or guidance on assessment best practices
- Stay updated on current trends in educational and psychological testing
Requirements
Text copied to clipboard!- Bachelor’s or Master’s degree in Education, Psychology, or related field
- Experience in assessment design and evaluation
- Strong analytical and statistical skills
- Familiarity with psychometric principles and testing standards
- Proficiency in data analysis tools (e.g., SPSS, R, Excel)
- Excellent written and verbal communication skills
- Attention to detail and strong organizational skills
- Ability to work independently and collaboratively
- Knowledge of compliance and ethical standards in testing
- Experience with digital assessment platforms is a plus
Potential interview questions
Text copied to clipboard!- What experience do you have with assessment evaluation?
- Can you describe a time you improved an assessment tool?
- What statistical methods do you use for item analysis?
- How do you ensure the fairness of an assessment?
- What tools or software are you proficient in for data analysis?
- How do you stay current with trends in assessment and evaluation?
- Have you worked with subject matter experts before?
- What is your approach to validating a new assessment?
- How do you handle conflicting feedback on assessment quality?
- What role does psychometrics play in your evaluation process?
